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Enhancement  of  Stochastic  Resonance  by  Tuning  System 
Parameters  and  Adding  Noise  Simultaneously 

Xingxing  Wu,  Zhong-Ping  Jiang,  and  Daniel  W.  Repperger 


Abstract —  The  stochastic  resonance  effect  can  be  realized 
by  tuning  system  parameters  or  by  adding  noise.  This  paper 
investigates  the  possibility  to  enhance  the  stochastic 
resonance  effect  by  tuning  system  parameters  and  adding 
noise  simultaneously.  First,  we  use  some  examples  to 
demonstrate  the  situation  where  only  the  system  parameters 
or  noise  can  be  adjusted  for  maximizing  the  stochastic 
resonance  effect.  Then,  it  is  shown  using  standard 
optimization  theory  that  the  normalized  power  normal  <  c,  > 
of  the  bistable  double-well  system  with  aperiodic  input  signal 
can  reach  a  larger  maximal  value  by  tuning  the  system 
parameter  and  adding  noise  simultaneously.  Finally,  for  the 
purpose  of  practical  implementation,  searching  for  the 
optimal  system  parameter  and  noise  intensity  is  realised  by 
an  on-line  fast-converging  optimization  algorithm. 

Index  Terms—  stochastic  resonance,  signal  processing,  and 
optimization. 

I.  INTRODUCTION 

Stochastic  resonance  (SR)  is  the  phenomenon  that  the 
noise  can  be  used  to  enhance  rather  than  hinder  the 
system  performance.  The  noise  can  excite  the  richness  of 
the  nonlinearities  and  provides  improved  dynamics  which 
better  enables  the  system  to  increase  signal-to-noise  ratio 
(SNR)  or  mutual  information.  The  concept  of  stochastic 
resonance  was  first  proposed  by  Benzi  in  1981,  addressing 
the  problem  of  the  periodically  recurrent  ice  ages  [1].  Over 
the  last  two  decades,  stochastic  resonance  has  been 
continuously  attracting  considerable  attention.  It  is  a 
ubiquitous  and  conspicuous  phenomenon.  Many  nonlinear 
systems  have  demonstrated  the  stochastic  resonance  effects, 
such  as  discrete  systems  [4],  dynamic  systems  [2],  static 
systems  [5],  coupled  systems  [6]  and  random  systems  [7]. 
The  signal  can  be  periodic  [2],  aperiodic  [8],  subthreshold 
[2]  or  suprathreshold  [9].  In  order  to  quantify  the  stochastic 
resonance  phenomena  and  reveal  the  synchronization 
between  signals  and  noise,  different  measures  have  been 
adopted.  For  the  periodic  signals,  the  most  commonly  used 
quantifier  is  signal-to-noise  ratio  (SNR)  [2].  For  aperiodic 
signals,  cross-correlation  measures  [10],  power  norm  [8] 
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and  information-based  measures,  such  as  mutual 
information  [11],  are  used  instead.  Over  the  years, 
stochastic  resonance  has  been  applied  in  wide-range  of 
areas,  such  as  physics,  chemistry,  biomedical  sciences,  and 
engineering  [2-3].  One  of  the  important  applications  of 
stochastic  resonance  is  in  signal  processing.  As  a  nonlinear 
signal  processor,  it  has  been  used  for  signal  detection  [12- 
13],  signal  transmission  [14-15]  and  signal  estimation  [16]. 
In  order  to  realize  the  stochastic  resonance  so  as  to  make 
the  chosen  quantifier,  e.g.  the  output  signal-to-noise  ratio 
(SNR),  reach  its  maximal  value,  certain  conditions  must  be 
satisfied.  The  traditional  way  is  to  adjust  the  noise  intensity 
by  adding  optimal  amount  of  noise.  Recently,  tuning  system 
parameters  have  been  demonstrated  to  be  a  better  method  to 
realize  stochastic  resonance,  especially  when  the  initial 
input  noise  level  already  exceeds  the  resonance  region  [17- 
19].  The  output  SNR  will  reach  a  higher  maximal  value  by 
tuning  system  parameters  than  by  adjusting  noise  intensity 
[18].  Among  this  research,  either  the  noise  intensity  is 
adjusted  or  the  system  parameters  are  tuned  in  order  to 
maximize  the  chosen  measure,  but  not  both.  This  paper  will 
investigate  the  possibility  to  further  increase  the  maximum 
by  tuning  the  system  parameters  and  by  adding  noise 
simultaneously.  This  will  in  turn  improve  the  system 
performance  when  used  as  the  nonlinear  signal  processor 
for  signal  detection,  signal  transmission  or  signal 
estimation. 

The  rest  of  this  paper  is  organized  as  follows.  In  Section 
2,  we  demonstrate  the  cases  when  only  system  parameters 
or  noise  intensity  can  be  adjusted.  Section  3  will  prove  the 
possibility  to  further  increase  the  maximal  value  of 
normalized  power  norm  [8]  of  the  aperiodic  stochastic 
resonance  in  bistable  double-well  system  by  adjusting 
system  parameters  and  noise  intensity,  based  on  the 
conventional  first-order  necessary  condition  and  second- 
order  sufficient  condition  in  optimization  theory.  Section  4 
will  provide  an  on-line  fast-convergent  optimization 
algorithm  to  search  the  optimal  system  parameters  and 
noise  intensity.  Section  5  is  devoted  to  verify,  via  computer 
simulations,  the  improvement  of  maximal  <C|>  by 
comparing  the  maximal  normalized  power  norm  obtained 
by  tuning  system  parameters,  by  adding  noise  and  by  both. 
Finally,  Section  6  closes  the  paper  with  brief  concluding 
remarks. 


II.  STOCHASTIC  RESONANCE  VIA  TUNING  SYSTEM 
PARAMETERS  OR  ADDING  NOISE 


In  some  stochastic  resonance  systems,  the  chosen 
measures  can  be  described  as  a  function  of  both  the  system 
parameters  and  the  noise.  This,  however,  does  not  ensure 
that  both  system  parameters  and  noise  can  be  adjusted  at  the 
same  time  to  maximize  or  minimize  these  quantifiers.  In 
[20],  the  output  signal-to-noise  ratio  is  affected  by  the  ratio 
of  noise  variance  and  system  parameter  (threshold),  rather 
than  by  the  parameter  value  and  noise  individually.  The 
paper  [17]  shows  that  the  noise  intensity  cannot  be  adjusted 
and  must  be  fixed  at  the  initial  value  (no  noise  will  be 
added)  in  order  to  minimize  the  bit  error  rate  (BER)  for  the 
aperiodic  stochastic  resonance  (ASR).  In  this  case,  only 
system  parameters  tuning  is  meaningflil.  In  what  follows  we 
will  demonstrate  this  is  also  true  for  the  periodic  stochastic 
resonance  in  double-well  bistable  dynamic  systems. 

The  double-well  bistable  system  is  described  by  the 
equation  [21]: 

T^x(t)=x{t)-^^  +  s{l)  +  7](t)’ 


where  system  parameters  >  0,  Xb  >  0.  The  periodic  input 
is  s{t)  =  A  cos(2;a  /  f, )  •  T]{t)  is  an  additive  Gaussian  white 


noise  with  zero  mean  average  and  autocorrelation  of 
<7]{t)7]iO)>=2DS(t). 

For  small  and  slow  input  signal,  the  output  signal-to- 
noise  ratio  is  given  by  [21]: 

(2) 


SNR 


rrA-XllA  ,  X;/4^ 
=  V2^,r^exp(-^) 


Dir 


Assuming  parameter  is  fixed,  the  output  SNR  is  a 

function  of  both  system  parameter  Xb  and  noise  intensity  D. 
One  constraint  on  the  noise  intensity  is  that  it  should  not  be 
less  than  the  initial  value  Dq.  There  are  also  constraints  on 
the  parameter  X^.  For  example,  A'j>V27/1/2  for  the 
subthreshold  system  [17]. 

To  prove  our  above  claim,  assume  the  SNR  is  maximized 
at  the  optimal  values  (Xl,D‘)-  Obviously,  there  will  be  a 

local  maximizer  for  this  optimization  problem  if  both 
system  parameter  Xb  and  noise  intensity  D  can  be  adjusted 
at  the  same  time.  According  to  the  first-order  necessary 
condition  for  a  local  maximizer,  we  have  VSNR(X^,D)  =  0, 

and  thus: 

Xl=SD,X^,=4D  ,  (3) 

The  derived  solution  (Xb  =  0  and  D  =  0)  does  not  meet 
the  constraint  requirements.  In  other  words,  this 
constrained  optimization  problem  has  no  local  maximizer. 
This  means  either  system  parameter  Xb  or  noise  D,  but  not 
both,  can  be  adjusted  to  maximize  the  output  SNR. 

In  order  to  determine  which  one  will  take  the  extremum 
and  which  one  is  not  adjustable,  we  can  rescale  the 
variables  as: 


x  =  t/T,,  y  =  x,frjb,  X,=X,„JfjD, 


A  =  A^TJD,  x^=xJT^-  (4) 

For  the  rescaled  y-system,  its  noise  density  becomes  unit 
and  the  output  SNR  is: 


SNR  =  42 


AX, 


(1/D) 


/4  ,  X 

exp(- 


■/4, 


Mr., 


(5) 


Now,  the  optimization  parameters  are  A  and  ■ 

Obviously,  A  should  take  the  maximal  value  in  order  to 
maximize  SNR.  From  (4),  this  means  that  the  noise 
intensity  should  be  fixed  to  its  initial  value  Do  which  is  also 
the  minimal  noise  intensity,  assuming  the  signal  amplitude 
A  is  not  changeable.  Again,  only  system  parameter  Xb  can 
be  adjusted. 

In  the  next  section,  we  will  examine  some  interesting 
situations  where  both  the  system  parameters  and  noise 
intensity  can  be  adjusted  simultaneously  to  improve  the 
stochastic  resonance  effect. 


III.  STOCHASTIC  RESONANCE  ENHANCEMENT 


In  [22],  the  aperiodic  stochastic  resonance  (ASR)  was 
demonstrated  in  the  bistable-well  system.  The  cross¬ 
correlation  measures  (power  norm  Co  and  normalized 
power  norm  Ci)  were  adopted  for  characterizing  the  ASR 
behaviour: 


Co  =  max{5'(0R(t  + 1)} 


c,=- 


(6) 


[5^(or^P(o-)?(of}'” 

where  S(t)  is  the  zero-mean  aperiodic  input  signal,  R(t)  is 
the  mean  transition  rate  of  the  system. 

The  symmetric  bistable-well  system  with  a  fluctuating 
barrier  is  given  by  [22]: 


dx 


dU 

dx 


(7) 


where 


Uix)  =  -[A-Sm^+^ 

2  4 


is  the  potential  function. 


Usually,  A  is  a  constant.  Here  A  will  be  taken  as  a  system 
parameter.  is  Gaussian  white  noise  with  zero  mean 
average  and  autocorrelation  of  <  >=  2DS{t-s)  ■  The 


angular  brackets  denote  an  ensemble  average. 

In  general,  the  power  norm  does  not  have  an  explicit 
expression.  For  the  specific  case  where  the  signal  amplitude 
is  small  compared  with  the  barrier  height,  i.e.,  s{ty  «A'‘, 
and  S(t)  is  a  Gaussian-distributed  signal,  <Co>  and  <Ci> 
are  given  as  [22]: 

<C„>=eAexp[-©  +  A^S^/2]5'(0> 

.p,  (9) 

'  {expIA^SnOl  - 1  +  (r(D)Q-^  exp[20  -  A"5-(0]}''" 


where £;•(/))- <  R{t)  >><R(t)  >=  gexp[-0+A’s’(i)/2] 
Q  =  k^Al42rr,Q  =  A^ /AD,^  =  A/2D 


We  will  choose  <Ci>  as  the  objective  function  to  be 
maximized.  The  theoretic  expression  of  <Ci>  can  predict  its 
real  shape,  even  when  the  noise  intensity  is  outside  the 
range  of  its  validity  [22].  So,  we  can  form  the  following 
constrained  optimization  problem: 
max  <  C,  ^ 

subject  to  S(t)-  «  A\  D  > 

The  optimization  parameters  are  the  system  parameter  A 
and  the  noise  intensity  D.  From  the  expressions  of  © 
and  A ,  we  notice  that  0  is  a  function  of  Q  and  A : 

q  =  =  (11) 

2K, 

where  c=~hnl2k^  is  a  constant,  Q  and  A  are  functions  of  A 
and  D. 

The  <C]>  can  be  expressed  in  term  of  Q  and  A : 

<C,>= - - - ^ _ _  .  (12) 

{exp[A^i^]  -I  +  A:,g-'  expfcAg  +  rfA^]}''^ 


where  and  d:=S\t)/2-S^Q)=~~. 

Therefore  we  will  be  interested  in  maximizing  <Ci>  at 
some  nonzero  optimal  values  Q"  and  A* . 

From  the  simulation,  we  find  that  there  is  a  unique  local 
maximizer  for  the  unconstrained  optimization  problem,  i.e. 
(10)  without  the  constraints.  Unfortunately,  the  local 

maximizer  (g*  and  A*)  cannot  meet  the  constraint 
requirements  for  some  input  signal.  For  example,  when 
s=0.01,  we  will  have  A*  =142.791,  g*  =0.0032,  A*=0.014. 
It  cannot  meet  the  requirement  of  small  signal  (  s(ty  «  a'‘  )• 

So  we  introduce  two  additional  parameters  (a>0,  b>0) 
into  the  system  by  defining; 

U^x)  =  -[A-S(t)]^  +  ^  >  (13) 

2a  Ab 

We  can  then  get: 

<  c,  >=  — — - _ .  (14) 

(exp[j^A^]  - 1  +  k,Q~'  exp[caA2  +  rfA^])'” 
where:  q  =  k^Al^an,®  =  bA^  =  bA/2a^D,Q  =  caAQ  • 

From  (14),  one  sees  that  the  bigger  the  parameter  a,  the 
smaller  the  <C,>  will  be.  Here  parameter  a  will  be  taken  as 
a  supporting  parameter  used  to  adjust  the  local  maximizer 
( 2*  >  A  )  to  enable  A*  and  D*  to  meet  the  constraints. 
Parameter  b  is  also  taken  as  a  supporting  parameter  which 
will  be  used  to  match  parameter  a  to  keep  the  potential 
function  in  good  shape  and  make  the  optimal  noise  intensity 
D*  reasonable.  For  example,  we  can  let  b/  (2a^)  be  a  proper 
constant. 


Proposition  I:  There  exists  one  and  only  one  pair  of 
parameters  (g’,A  )  satisfying  the  first-order  necessary 
condition  of  this  unconstrained  optimization  problem. 


Proof:  First,  it  is  shown  that  the  first-order  necessary 
condition  has  at  least  one  solution; 

From  the  first-order  necessary  condition; 


We  get: 
caAQ  =  1, 


3<C  |> 
aA 


=  0  and 


a<c,  > 
3G 


=  0. 


(2  -  ’a’ )  exp[i  ^A’  ]  -  2 


(15) 

(16) 


+  *1(22  '  -caA-2dls'Q  ' ) expfcagA  +  rfA^ ]  =  0 


Letting  g  '  =  ca  A ,  we  have 
(2  -  25 expfj^A^  ]  -  2 
+cuA:,(A  -  2c/A’)  exp[l  +  tf  A^]  =  0 


(17) 


Let  A)  denote  the  left  hand  of  equation  (17). 
Obviously,  f  (0)  =  0  and  f  (-1-  00  )  =  .  cx> ,  Also: 

•^=  (-45^A-45‘'A’)exp[5^A^] 
oA 

+i|Cf7(l  +  25^A^  -  j''A‘')exp[l  +  £/A^]  ’ 


If  A  — >  0'^ ,  we  get  Q .  We  can  conclude  that  there  is 
3a 

at  least  one  A  >  0  satisfying  eq.  (17). 

Now,  we  need  to  prove  that  the  solution  is  unique  for 
fixed  parameters  a  and  b. 

Let/(A)  =  (2-25^A^)exp[jW].  The  function  /|(A)  will 
decrease  monotonically  to  -  ©o  as  A  — >  ©o,  starting  from 
/i(0)  =  2 .  We  denote  the  rest  part  of  the  LHS  of  equation 
(17)  as  function  /j(A)  =  ca*,A(l  +  s'A')exp[l-5'AV2].  It 
will  first  increases  from  zero,  and  then  decreases  to  zero. 
From  these  special  characteristics  of  /^(a)  and  /j(A),  it 

follows  readily  that  equation  (17)  can  only  have  one  positive 
solution. 

Proposition  2:  The  parameter  a  can  be  used  to  continuously 
adjust  the  values  of  g*  and  A*  satisfying  the  first-order 
necessary  condition  of  the  unconstrained  optimization 
problem  to  ensure  A*  and  D*  will  meet  the  constraint 
requirements. 

Proof:  From  (17)  and  definitions  of  /^jA)  and  ffA),  we 
notice  that  parameter  a  only  affects  ffA),  but  not  /^(a) 
which  is  a  decreasing  function  of  A.  The  increase  of 
parameter  a  will  increase  the  value  of/2(A)  for  the  same 

A.  This  will  in  turn  increase  A*.  Also,  A’  will  approach 
zero  when  parameter  a  approaches  zero.  This  means  that 

A  can  be  changed  continuously  by  adjusting  parameter  a. 

Proposition  3:  There  is  one  and  only  one  local  maximizer 
for  the  unconstrained  optimization  problem  with  small 
input  (s«l)  and  properly  chosen  parameters  a  and  b. 


Proof.  Assume  the  pair  ( g* ,  A* )  is  the  only  solution 
satisfying  the  first-order  necessary  condition.  We  need  to 
prove  the  pair  will  also  satisfy  the  sufficient  condition  of  the 
unconstrained  optimization  problem,  that  is,  the  Hessian 
matrix  v-  <  C,  >  (A',e')  is  negative  definite. 

At  the  point  ( Q*  >  A* ),  we  have:  ' 

a-  <  c,  > 

(19) 

I 

2(-i’A'^)[jA'  exp[i^A'’]  +  t:,ca( —  + - )]exp[l  -5^A‘“  /2] 

_ 2  4 _ 

(exp[j^ A‘'‘  ]  - 1  +  k,Q'-'  exp[l  +  rfA '"])’'' 

9^  <  C,  >  _ _ _  (20) 

ag'^  2(exp[5'A’'  ]  - 1  +  k^Q'-'  exp[l  +  dh'^  ])’'^  ’ 

a^  <  C|  >  ^  a^  <  C|  >  _ 

aA'ag*  ag’aA*  ,  (2i) 

(-fc,c^a^.rA‘^)exp[l-rrfA‘^] 

2(exp[j'A’']-l  +  it,e‘-'  exp[l  +  cfA’^])’”  ' 

We  have:  (for  s«l) 

2j^A‘^  exp[j^A*^] 

+  2kfast^{-\  /  2  +  /  4)  exp[  1  -  j /  2] 

=  2exp[j^A‘^]-2 

+  it,caA‘[(l  -i)  +  s'A‘'(l  +  j  /  2)]  exp[l  -  5'A*'  /  2] 

=  25^A'^  exp[j^A‘^]  >  0 

So  9^  <C|  >  for 2',  A* ,  and  small  input  signal  (s«l). 

3A'^ 

If  the  parameter  a  is  adjusted  properly  such  that 
s(A*)^»l,  the  numerator  of  the  Hessian  matrix 
determinant  value  is: 

2exp[j^A*^]-2 

+  k.ca{K  — +  j^A*’)  exp[l  -  5^A*^  /  2] 

5A 

=  2exp[5^A*^]-2 
+  A:,ca(A‘  -1-  i 'A'' )  exp[l  -  i'A*'  /  2] 

=  2s^A'^  exp[j^A*^]  >  0 

From  the  standard  test  on  negative-definiteness  of  a 
symmetric  matrix,  it  follows  that  the  Hessian  matrix  is 
negative  definite.  This  completes  the  proof  of  Proposition  3. 

Proposition  4:  There  is  one  and  only  one  local  maximizer 
for  the  original  constrained  optimization  problem  (10)  with 
small  input  and  properly  chosen  parameter  a  and  b. 

Proof.  From  above,  we  can  get  A*=2/  A* .  In  order  to  satisfy 
the  constraint:  (A*)^  »s^,  we  should  have  s^(A*)^«4. 

Combined  with  the  requirement  s(A*)^»l,  we  should 
have:  s«s^{Kf  «4  for  small  input  signal  (s«l).  This 
can  be  satisfied  by  adjusting  parameter  a.  Also,  D*  will  be 
greater  than  Dq  for  the  properly  chosen  parameter  b. 


Therefore,  Proposition  4  follows  directly  from  Proposition 
3. 

Proposition  5:  The  local  maximizer  (A*,  D*)  is  also  the 
global  maximizer  of  the  constrained  optimization  problem 
(10). 

Proof.  It  follows  from  Proposition  4  and  the  fact  that  the 
first-order  necessary  condition  only  has  one  solution. 

From  the  above  analysis,  the  normalized  power  norm 
<C,>  of  the  double-well  bistable  system  with  Gaussian- 
distribution  input  signal  can  be  maximized  by  tuning 
system  parameter  A  and  adding  noise  simultaneously  and 
will  reach  a  higher  maximal  value  than  that  of  adjusting 
only  the  system  parameter  or  noise  intensity. 

IV.  OPTIMIZATION  ALGORITHM 

There  is  no  elosed-form  solution  for  the  constrained 
optimization  problem  in  Section  3.  The  maximizer  can  be 
obtained  by  solving  the  nonlinear  equation  (17)  with  the  aid 
of  standard  optimization  algorithms.  In  some  situations, 
however,  this  optimization  problem  should  be  solved  on¬ 
line  with  changing  input  signals,  such  as  the  case  of  high¬ 
speed  target  detection  when  it  is  used  as  the  nonlinear 
signal  processor.  The  speed  is  a  critical  requirement  in 
these  situations.  This  makes  the  development  of  an  on-line 
fast  convergent  optimization  algorithm  an  issue  of  crucial 
importance. 

Let  /(A)  be  the  left  part  of  equation  (17).  Noting  that 
V/(A’)  is  nonsingular  for  small  input  signals,  the  following 
result  can  be  proved  using  standard  arguments  from  [23]: 

Proposition  6:  The  Newton’s  Method  for  Nonlinear 
Equations,  when  applied  to  solving  /(A*)  =  0,  gives  a 

local  Q-quadratic  convergence,  if  Ap  is  sufficiently  close  to 

A*. 

Our  proposed  optimization  algorithm  is  based  on  the 
Newton  Algorithm.  The  optimization  algorithm  is  divided 
into  two  categories.  The  fist  case  is  when  parameters  a  and 
b  are  fixed.  They  are  properly  chosen  so  that  the  pair  of 
optimal  solutions  (A*,  D*)  for  the  unconstrained 
optimization  problem  can  meet  the  given  constraints.  The 
second  case  is  when  parameter  a  should  also  be  adjusted  on¬ 
line.  Here  we  assume  parameter  b  is  a  pre-defined  function 
of  parameter  a.  For  example,  b/{2a^)  =  const. 

Case  I: 

The  convergence  speed  of  the  Newton  algorithm  depends 
on  the  initial  value  Ap.  We  propose  a  way  to  estimate  the 

initial  value  for  different  input  signals  on-line,  based  on  a 


table  or  function  constructed  off-line.  The  table  or  the 
function  describes  the  relationship  between  input  signal 

average  amplitude  s  and  the  optimal  value  A*  which  can  be 

got  off-line.  For  a  given  input  signal  s,  A*  will  first  be 
estimated  using  interpolation  for  the  table  or  direct 
calculation  for  the  function  constructed  off-line.  This 

A*  will  then  be  used  as  the  initial  value  Aq  for  this  input 

signal.  It  will  be  close  to  the  optimal  value  to  ensure  the 
required  convergence  speed,  if  the  table  or  the  function  is 
constructed  properly. 

Algorithm  1: 

Step  1: 

Calculate  its  average  amplitude  value  s=s^(t)  for 
the  given  input  signal; 

Step  2: 

Estimate  initial  A^,  using  the  constructed  table  or 

function; 

Step  3; 

Solve  /(A* )  =  0  using  normal  Newton  Algorithm 

[23]; 

Step4: 

Calculate  Q*,  A*  and  D*  and  stop. 

Case  2: 

If  adjustable,  the  smallest  parameter  a  ensuring  the 
satisfaction  of  constraints  will  maximize  <Ci>. 

Similarly  we  can  rely  on  the  off-line  work  to  increase  the 
convergence  of  the  on-line  algorithm.  Two  tables  or  two 
functions  will  be  constructed  off-line.  The  first  table  or 
function  describes  the  relationship  of  A  *  with  input  s  and 
parameter  a.  The  second  table  or  function  is  the  relationship 
of  input  signal  s  with  a*,  where  a*  is  the  smallest  parameter 
a  for  the  above-stated  constrained  optimization  problem 
with  input  signal  s. 

Algorithm  2: 

Step  1: 

Calculate  s=s^{t),  set  Xq  =  0,>’g  =  +°° 

Step  2; 

Estimate  a*,  take  it  as  the  initial  value  ao; 

Step  3:  Estimate  the  initial  value  A^ ; 

Step  4: 

Solve  /(A* )  =  0  using  normal  Newton  Algorithm 

[23]; 

Step  5; 

Ifs  «  s^(A’y: 

.Vt+I  =  “* .  +  Xm  ) !  2 

else; 


Vm  =+°°- 

Om  =  2at 

else: 

Step  6: 

\<e-. 

Calculate  Q*,  A*  and  D*  and  stop. 

else: 

Go  back  to  Step  3 
V.  SIMULATION  RESULTS 

In  order  to  verify  the  improvement  of  the  maximal  value 
of  normalized  power  norm  <C|>  by  adjusting  system 
parameter  A  and  noise  intensity  D  simultaneously  over  that 
by  adjusting  system  parameter  A  or  noise  intensity  D  alone, 
simulation  is  performed.  The  following  is  the  simulation 
result:  (Ko=l,  K|=0.019,  a=0.001,  and  A=1  when  adjusting 
D,  and  D=0. 1  when  adjusting  A) 


Fig.  1.  Comparison  of  Maximal  <Ci> 


V.  CONCLUSION 

This  paper  demonstrates  the  possibility  to  further 
enhance  the  stochastic  resonance  effect  if  the  system 
parameter  and  the  noise  intensity  can  be  adjusted  at  the 
same  time.  The  enhancement  of  the  stochastic  resonance 
effect  will  in  turn  improve  the  system  performance  and  have 
wide  application  in  signal  and  image  related  engineering 
problems  such  as  target  detection.  Specifically,  the 
nonlinear  signal  processor  based  on  stochastic  resonance 
will  increase  the  target  detection  performance  if  it  has  a 
higher  output  signal-to-noise  ratio. 

References 

[1]  R.  Benzi,  A.  Sutcra  and  A.  Vulpiani,  "The  mechanism  of  stochastic 
resonance,"  J.  Phys.  A,  vol.  14,  no.  1 1,  L453,  1981. 

[21  L.  Gammaitoni,  P.  Hanggi,  P.  Jung  and  F.  Marchesoni,  “Stochastic 
resonance,”  Reviews  of  Modem  Physics,  vol.  70,  no.  1,  pp.  223-287, 
1998. 

[3]  T.  Wellens,  V.  Shatokhin  and  A.  Buchleitner,  “Stochastic  resonance,” 
Reports  on  Progress  in  Physics,  67,  pp.  45-1 05, 2004. 


[4]  S.  Zozor  and  P.  O.  Amblard,  “Stochastic  resonance  in  discrete  time 
nonlinear  AR  (1)  models,”  IEEE  Transactions  on  Signal  Processing,  vol. 
47,  no.  1,  1999. 

[5]  F.  Chapcau-Blondcau  and  X.  Godivier,  “Theory  of  stochastic  resonance 
in  signal  transmission  by  static  nonlinear  systems,”  Phys.  Rev.  E,  vol. 
55,  no.  2,  1997. 

[6]  P.  Jung,  U.  Behn,  E.  Pantazeloii  and  F.  Moss,  “Collective  response  in 
globally  coupled  bistable  systems,”  Phys.  Rev.  A,  vol.  46,  no.  4,  Aug. 
1992. 

[7]  S.  M.  Bezrukov  and  I.  Vodyanoy,  “Stochastic  resonance  in 
nondynamical  systems  without  response  thresholds,”  Nature,  vol.  385, 
pp.  3 19-321,  Jan.  1997. 

[8]  J.  J.  Collins,  C.  C.  Chow  and  T.  T.  Imhoff,  “Aperiodic  stochastic 
resonance  in  excitable  systems,”  Physical  Review  E,  vol.  52,  no.  4, 

1995. 

[9]  N.  G.  Stocks,  “Suprathreshold  stochastic  resonance  in  multilevel 
threshold  systenjs,”  Physical  Review  Letters,  vol.  84,  no.  11, 2000. 

[10]  K.  Park,  Y.  C.  Lai,  Z.  Liu  and  A.  Nachman,  “Aperiodic  stochastic 
resonance  and  phase  synchronization,”  Physics  Letters  A,  326  (2004) 
391-396. 

[11]  G.  Deco  and  B.  Schurmaiui,  “Stochastic  resonance  in  the  mutual 
information  between  input  and  output  spike  trains  of  noisy  central 
neurons,”  Phys.  D,  vol.  1 17,  pp.  276-282,  1998. 

[12]  A.  A.  Saha,  G.  V.  Anand,  “Design  of  detectors  based  on  stochastic 
resonance,”  Signal  Processing,  vol.  83,  issue  6,  pp.  1 193-1212, 2003. 

[13]  S.  Zozor  and  P.  -O.  Aonblard,  “On  the  use  of  stochastic  resonance  in  sine 
detection,”  Signal  Processing,  vol.  82,  no.  3,  pp:  353-367, 2002. 

[14]  X.  Godivier  and  F.  Chapcau-Blondcau,  “Noise-assisted  signal 
transmission  in  a  nonlinear  electronic  comparator:  experiment  and 
theory,”  Signal  Processing  56:  293-303,  1 997. 

[15]  N.  G.  Stocks,  “Information  transmission  in  parallel  threshold  arrays: 
Suprathreshold  Stochastic  Resonance,”  Physical  Review  E,  vol.  63, 
2001. 

[16]  F.  Chapeau-Blondeau  and  D.  Rousseau,  “Noise-enhanced  performance 
for  an  optimal  Bayesian  estimator,”  IEEE  Transactions  on  Signal 
Processing,  vol.  52,  no.  5,  May  2004. 

[17]  B.  Xu,  F.  Duan  and  F.  Chapeau-Blondeau,  “Comparison  of  aperiodic 
stochastic  resonance  in  a  bistable  system  realized  by  adding  noise  and  by 
tuning  system  parameters,”  Physical  Review  E  69, 2004. 

[18]  B.  Xu,  F.  Duan,  R.  Bao  and  J.  Li,  “Stochastic  resonance  with  tuning 
system  parameters:  the  application  of  bistable  systems  in  signal 
processing,”  Chaos,  Solitons  and  Fractals,  13:633-644, 2002. 

[19]  B.  Xu,  J.  Li  and  J.  Zheng,  “How  to  tune  the  system  parameters  to  realize 
stochastic  resonance,”  J.  Phys,  A:  Math.  Gen,  36  (2003)  1 1969-1 1980, 
2003. 

[20]  P,  Jung,  “Stochastic  resonance  and  optimal  design  of  threshold 
detectors,”  Physics  Letters  A  207  (1995)93-104. 

[21]  F.  Chapeau-Blondeau,  “Stochastic  resonance  and  the  benefit  of  noise  in 
nonlinear  systems,”  Noise,  Oscillators  and  Algebraic  Randomness  — 
From  Noise  in  Communication  Systems  to  Number  Theory,  pp.  137- 
1 55;  M.  Planat,  ed.,  Lecture  Notes  in  Physics,  Springer  (Berlin),  2000. 

[22]  J.  J.  Collins,  Carson  C.  Chow,  Ann  C.  Capela  and  Thomas  T.  Imhoff, 
“Aperiodic  stochastic  resonance,”  Physical  Review  E,  vol.  54,  no.  5, 

1996. 

[23]  J.  Noccdal  and  S.  J.  Wright,  “Numerical  Optimization,”  Springer-Verlag 
New  York,  Inc.,  1999. 


